Exploration Across Small Silos: Federated Few-Shot Learning on Network Edge

نویسندگان

چکیده

Federated Learning (FL) has been drawing significant attention from both academia and industry working on distributed machine learning. In practice, learning over mutually isolated datasets residing at the network edge, also known as silos, FL clients can suffer a lack of samples, due to many reasons (e.g., expensive annotation), this potentially negative impact performance. Few-Shot (FSL) considered promising solution, but unfortunately cannot be directly applied practical Cross-Silo (CSFL) systems. article, far we know, conduct first systematic discussion specific challenges FSL in CSFL We extract essential design issues found (FFSL), develop new FFSL method based Model-Agnostic Meta (MAML). Through experiments using real-world federated datasets, comprehensively demonstrate our method's advantages existing methods different scenarios where hitherto failed. highlight some future research directions.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Learning to Compare: Relation Network for Few-Shot Learning

We present a conceptually simple, flexible, and general framework for few-shot learning, where a classifier must learn to recognise new classes given only few examples from each. Our method, called the Relation Network (RN), is trained end-to-end from scratch. During meta-learning, it learns to learn a deep distance metric to compare a small number of images within episodes, each of which is de...

متن کامل

Few-shot Learning

Though deep neural networks have shown great success in the large data domain, they generally perform poorly on few-shot learning tasks, where a classifier has to quickly generalize after seeing very few examples from each class. The general belief is that gradient-based optimization in high capacity classifiers requires many iterative steps over many examples to perform well. Here, we propose ...

متن کامل

Dynamic Input Structure and Network Assembly for Few-Shot Learning

The ability to learn from a small number of examples has been a difficult problem in machine learning since its inception. While methods have succeeded with large amounts of training data, research has been underway in how to accomplish similar performance with fewer examples, known as one-shot or more generally few-shot learning. This technique has been shown to have promising performance, but...

متن کامل

One-shot and few-shot learning of word embeddings

Standard deep learning systems require thousands or millions of examples to learn a concept, and cannot integrate new concepts easily. By contrast, humans have an incredible ability to do one-shot or few-shot learning. For instance, from just hearing a word used in a sentence, humans can infer a great deal about it, by leveraging what the syntax and semantics of the surrounding words tells us. ...

متن کامل

Few-Shot Learning with Graph Neural Networks

We propose to study the problem of few-shot learning with the prism of inference on a partially observed graphical model, constructed from a collection of input images whose label can be either observed or not. By assimilating generic message-passing inference algorithms with their neural-network counterparts, we define a graph neural network architecture that generalizes several of the recentl...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Network

سال: 2022

ISSN: ['0890-8044', '1558-156X']

DOI: https://doi.org/10.1109/mnet.111.2100329